Skip to content

feat: add telemetry generator docker setup and comprehensive PII types#62

Merged
jsirianni merged 8 commits intomainfrom
joearmstrong/ai-253-k8s-run-telemetry-generator
Jan 30, 2026
Merged

feat: add telemetry generator docker setup and comprehensive PII types#62
jsirianni merged 8 commits intomainfrom
joearmstrong/ai-253-k8s-run-telemetry-generator

Conversation

@joe-armstrong
Copy link
Contributor

@joe-armstrong joe-armstrong commented Jan 30, 2026

Summary

This PR adds a Docker Compose setup for running all Blitz generators simultaneously, along with a major expansion of the PII log generator to include 37 sensitive data types.

Docker Telemetry Generator

Added docker/ directory with:

  • docker-compose.telemetry-generator.yml - Runs all 10 Blitz generators in parallel, sending OTLP logs to a collector
  • collector-config.yaml - OTLP receiver configuration
  • README.md - Usage documentation

Quick start:

OPAMP_ENDPOINT=wss://your-server.com/v1/opamp \
OPAMP_SECRET_KEY=your-secret-key \
docker compose -f docker/docker-compose.telemetry-generator.yml up

Comprehensive PII Generator

Expanded the JSON generator's PII log type from 6 fields to 37 sensitive data types across categories:

Category Types
Core PII UUID, SSN, IBAN, US/International Phone, Email, Credit Card, DOB, IPv4, IPv6, MAC Address, Street/City/State/Zip
Government IDs Passport, Driver's License, National ID
Financial Bank Account, Routing Number, Crypto Wallet (BTC/ETH)
Healthcare Medical Record Number, Health Insurance ID
Vehicle VIN, License Plate
Employment Employee ID, Student ID
Auth/Secrets Username, Password Hash, API Key, AWS Access Key, Private Key, JWT Token
Location GPS Coordinates, Geohash
Personal Full Name, Mother's Maiden Name, Security Answer

Use Cases

  • Testing PII detection and redaction systems
  • Load testing OpenTelemetry collectors
  • Validating data masking pipelines
  • Generating realistic log data for development

Test Plan

  • go build ./... passes
  • go test ./... passes
  • Manual testing with docker compose

🤖 Generated with Claude Code

joe-armstrong and others added 7 commits January 30, 2026 12:09
…tz types to a BDOT collector"

This reverts commit c2b6e02cfad81a767f87ece0a67071dd7111d347.
Adds comprehensive PII data generation including:
- Credit Card numbers
- Date of Birth (multiple formats)
- Email addresses
- International phone numbers
- IPv6 addresses
- MAC addresses
- US street addresses
- US city/state
- US zip codes (5 and 9 digit)

All PII fields are now included in every generated log entry
for comprehensive sensitive data testing.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
…ata testing

Adds 37 total PII/sensitive data types across categories:

Core PII (14 types):
- UUID, SSN, IBAN, Phone (US/Intl), Email, Credit Card
- DOB, IPv4, IPv6, MAC Address, Street/City/State/Zip

Government IDs (3 types):
- Passport, Driver's License, National ID (non-US)

Financial (3 types):
- Bank Account, Routing Number, Crypto Wallet (BTC/ETH)

Healthcare (2 types):
- Medical Record Number, Health Insurance ID

Vehicle (2 types):
- VIN, License Plate

Employment/Education (2 types):
- Employee ID, Student ID

Authentication/Secrets (6 types):
- Username, Password Hash (bcrypt), API Key, AWS Access Key
- Private Key (RSA), JWT Token

Location (2 types):
- GPS Coordinates, Geohash

Personal (3 types):
- Full Name, Mother's Maiden Name, Security Answer

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Update json.md with all 37 PII types and examples
- Update docker README with PII architecture and BLITZ_PII_WORKERS env var
- Set PII generator to 10 workers (10x rate) for comprehensive testing
- Use non-Stripe API key prefixes to avoid false positives in secret scanning

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@joe-armstrong joe-armstrong marked this pull request as ready for review January 30, 2026 17:46
@joe-armstrong joe-armstrong requested a review from a team as a code owner January 30, 2026 17:46
@jsirianni jsirianni self-assigned this Jan 30, 2026
Copy link
Member

@jsirianni jsirianni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should the docker setup be kept up to date when new generators are added? If so, we should include some AI rules / hints.

Includes instructions for:
- Keeping docker telemetry generator in sync when adding new generators
- Updating PII generator when adding new sensitive data types
- Code style guidelines (e.g., lowercase "Bindplane")

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@joe-armstrong
Copy link
Contributor Author

@jsirianni Great idea! Added a Claude.md with a section to update the config when new generators are added.

@jsirianni jsirianni added this pull request to the merge queue Jan 30, 2026
Merged via the queue into main with commit 0906814 Jan 30, 2026
16 checks passed
@jsirianni jsirianni deleted the joearmstrong/ai-253-k8s-run-telemetry-generator branch January 30, 2026 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants